WHAT IS CLAIMED IS : 

1 . A computerized method of extracting a key frame from a video, comprising the 
steps of: 

a) providing a reference frame; 
5 b) providing a current frame different from the reference frame; 

c) deterniining a chromatic difference measure between the reference 
frame and the current frame; 

d) determining a structure difference measure between the reference 
frame and the current frame; and 

10 e) identifying the current frame as a key frame if the chromatic 

difference measure exceeds a chromatic threshold and the structure difference 
measure exceeds a structure threshold. 

2. The method defined in Claim 1, additionally comprising the step of setting the 
15 current frame to be the reference frame if a key frame is identified. 

3. The method defined in Claim 1, additionally comprising the step of repeating 
steps c-e for a new current frame until the end of the video is reached. 

20 4. The method defined in Claim 3, wherein the new current frame is selected to 
be at a predetermined time interval after the current frame. 

5. The method defined in Claim 4, wherein the predetermined time interval is 
user-selectable. 

25 

6. The method defined in Claim 1, wherein the value of the chromatic threshold 
and the value of the structure threshold are each user-selectable. 

7. The method defined in Claim 1, wherein the step of deterniining the structure 
30 difference measure is performed only if the chromatic difference measure exceeds the 

chromatic threshold. 
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8. A computerized method of extracting a key frame from a video having a 
plurality of frames, the method comprising the steps of: 

a) providing a reference frame; 

b) providing a current frame different from the reference frame; 

5 c) detenriining a first difference measure between the reference frame 

and the current frame; 

d) determining a second difference measure between the reference frame 
and the current frame; and 

e) identifying the current frame as a key frame if the first difference 
10 measure exceeds a first threshold and the second difference measure exceeds 

a second threshold. 

9. The method defined in Claim 8, additionally comprising the step of setting the 
current frame to be the reference frame if a key frame is identified. 

15 

10. The method defined in Claim 8, wherein the first difference measure is 
orthogonal to the second difference measure. 

11. The method defined in Claim 8, additionally comprising the step of repeating 
20 steps c-e for a new current frame until the end of the video is reached. 

12. The method defined in Claim 11, wherein the new current frame is selected to 
be at a predetermined time interval after the current frame. 

25 13. The method defined in Claim 8, wherein the value of the first threshold and 

the value of the second threshold are each user-selectable. 

14. The method defined in Claim 8, wherein the step of determining the second 
difference measure is performed only if the first difference measure exceeds the first 
30 threshold. 
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15. The method defined in Claim 8, wherein the second difference measure is 
computationally more expensive than the first difference measure. 

16. The method defined in Claim 8, wherein the second difference measure extracts 
5 more information than the first difference measure. 

17. The method defined in Claim 8, additionally comprising the step of 
determining a third difference measure between the reference frame and the current 
frame, and wherein the identifying step identifies the current frame as the key frame 

10 if the third difference measure exceeds a third threshold. 

18. A computerized method of extracting a key frame from a video having a 
plurality of frames, the method comprising the steps of: 

a) providing a reference frame; 
15 b) providing a current frame different from the reference frame; 

c) determining a structure difference measure between the reference 
frame and the current frame; and 

d) identifying the current frame as a key frame if the structure 
difference measure exceeds a structure threshold. 

20 

19. The method defined in Claim 18, additionally comprising the step of setting 
the current frame to be the reference frame if a key frame is identified. 

20. The method defined in Claim 18, additionally comprising the step of repeating 
25 steps c and d for a new current frame until the end of the video is reached. 

21. The method defined in Claim 20, wherein the new current frame is selected to 
be at a predetermined time interval after the current frame. 

30 22. The method defined in Claim 18, wherein the value of the structure threshold 
is user selectable. 
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KEY FRAME SELECTION 



Abstract of the Disclosure 
A system and method that processes video to extract a keyframe-based 
5 adequate visual representation. The method utilizes a hierarchical processing 
technique. The first stage in the hierarchy extracts a chromatic difference metric from 
a pair of video frames. An initial set of frames is chosen based on the chromatic 
metric and a threshold. A structural difference measurement is extracted from this 
initial set of frames. A second threshold is used to select key frames from the initial 
10 set. The first and second thresholds are user selectable. The output of this process 
is the visual representation. The method is extensible to any number of metrics and 
any number of levels. 
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